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Abstract 


We calculate the so-called Rademacher’s Grand Lebesgue Space norm for a 
centered (shifted) indicator (Bernoulli’s, binary) random variable. 

This norm is optimal for the centered and bounded random variables (r.v.) 

Using this result we derive a very simple bilateral sharp exponential tail esti¬ 
mates for sums of these variables, not necessary to be identical distributed, under 
non-standard norming, and give some examples to show the exactness of our esti¬ 
mates. 
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1 Introduction. Notations. Statement of prob¬ 
lem 

In order to formulate our result, we need to introduce some notations and conditions. 
Let {f2,R, P} be certain non-trivial probability space. Let also 0 = 0(A), A G 
(—Ao,Ao), Aq = const G (0, oo] be some even strong convex which takes positive 
values for positive arguments twice continuous differentiable function, such that 

0(0) = 0, 0^7o) > 0, 3 lim 0(A)/A > 0, (1.1) 

A^Ao 

including the case when the last limit is equal to inhnity. 

We denote the set of all these function as <h; <h = {0(-)}. 

We say by dehnition that the centered (mean zero) random variable (r.v) ^ = 
^((u) belongs to the Banach space B{(1)), if there exists some non-negative constant 
r > 0 such that 


VA G (—Ao, Ao) ^ Eexp(A^) < exp[0(A r)]. 


( 1 . 2 ). 


These spaces appears at first in the article [13]. The complete description and 
investigation of such a spaces may be found in a monograph [17], chapter 1, section 
1, p. 22-24. In particular, it was proved that these spaces are really complete Banach 
spaces. 

The function A —)■ Eexp(A.^) is said to be a moment generating function for the 
r.v. if there exists at least for one non zero value A. 

The value Aq in the considered in this report examples will be equal to inhnity: 
Ao = oo. 

Example 1.1. Let ?7 be a (renormed) Rademacher’s random variable: 

P{V = 1/2) = P(r/ = -1/2) = 1/2; 

then 


Eexp(A? 7 ) = cosh(A/2). 

Denote 0 _r(A) = lncosh(A/2); then rj G BcpR and \ \rj\B(l)R = 1. 

The function (pR^X) = lncosh(A/2) one can named as a natural function for the 
Rademacher’s random variable; see exact dehnition further. 

Evidently, 


0fl;(A) ~ A^/8, a —)■ 0; 0fi(A) ~ |A|/2, |A| —)■ oo. 

The minimal value r satisfying (1.2) is called a B{(j)) norm of the variable 
write 

||^||R(0) = inf{r, r>0; VA ^ Eexp(A0 < exp((/(A r))}. (1.3) 

The correspondent Grand Lebesgue Space norm will be named 

Rademacher’s norm. 

These spaces are very convenient for the investigation of the r.v. having a 
exponential decreasing tail of distribution, for instance, for investigation of the lim¬ 
it theorem, the exponential bounds of distribution for sums of random variables, 
other non-asymptotical properties of the random vectors and processes, problem of 
continuous of random helds, study of Central Limit Theorem in the Banach space 
etc. 

The space B{(j)) with respect to the norm || ■ \\B{(j)) and ordinary algebraic 
operations is a Banach space which is isomorphic to the subspace consisted on all 
the centered variables of Orliczs space {Q, F,P), N{-) with N — function 

N{u) = exp{(j)*{u)) — 1, = sup(Am — 0(A)). (1.4) 

A 

The transform 0 —)■ 0* is called Young-Fenchel, or Legendre transform. The 
proof of considered assertion used the properties of saddle-point method and theorem 
of Fenchel-Moraux: 

(j)** = 0 . 

The next facts about the 5(0) spaces are proved in [13], [17], p. 19 - 40. 



1. G -8(0) -v^ E,^ = 0, and 3C = const > 0, 


U{^,x) <exp{—(l)*{Cx)),x >0, (1.5) 

where Ux) denotes in this article the tail of distribution of the r.v. ^ : 

U{^,x) = niax(P(^ > x), P(^ < -x)), x>0, 

and this estimation is in general case asymptotically exact. 

Here and further C, Cj, C{i) will denote the non-essentially positive hnite ’’con¬ 
structive” constants. 

More exactly, if Aq = cxd, then the following implication holds: 

lim 0“^(logEexp(A.^))/A = K E (0, cxd) (1.6a) 

A—>-CXD 

if and only if 

ji^(0*)"^(|logf/(^,a;)|)/a; = l/K, (1.66) 

see [1]. 

Here and further denotes the inverse function to the function / on the 

left-side half-line (C, cxd). 

The function 0(-) may be constructive introduced by the formula 

0(A) = 0o(A) logsupEexp(A^(t)), (1.7) 

teT 

if obviously the family of the centered r.v. t G T} satishes the uniform 

Kramers condition; 

3/iG(0,cxD), supU{f(t), x) < exp{—fi x), a; > 0. (1.8) 

t&T 

In this case, i.e. in the case the choice the function 0(-) by the formula (1.7), we 
will call the function 0(A) = 0o(A) a natural function for the family of the centered 
r.v. {fit), t G T}. 

We say that the centered: E,^ = 0 numerical random variable (r.v.) f = 
ca G is subgaussian, or equally, belongs to the space Sub(ll), if there exists 
some non-negative constant r > 0 such that 

VA G-R ^ Eexp(A.^) < exp[A^ r^]. (1.9) 

The minimal value r satisfying (1.1) is called a subgaussian norm of the variable 
write 


||.^|| Sub = inf{r, r > 0 : VA G -R ^ Eexp(A.^) < exp(A^ 't^)}- 
Evidently, 


11.^| I Sub = sup 

At^O 



Eexp(AO/|A| 


( 1 . 10 ) 



So, the space Sub = Sub(r2) is the particular case of the general -8(0) spaces 
with 0(A) = 02(A) = A^, A G R. 

This important notion was introduced before the appearing of the general theory 
of -8(0) spaces by J.P.Kahane [10]; V.V.Buldygin and Yu.V.Kozatchenko [4] proved 
that the set Sub(r2) relative the norm || ■ || is complete Banach space which is 
isomorphic to subspace consisting only from the centered variables of Orlicz’s space 
over {Q,B,P) with N — Orlicz-Young function N{u) = exp(u^) — 1 [13]. 

If 11.^| I Sub = r G (0, cxd), then 

max[P(,^ > a;),P(.^ < —x)] < exp(—a;^/(4r^)), a; > 0; 

and the last inequality is in general case non-improvable. It is sufficient for this 
to consider the case when the r.v. ^ has the centered Gaussian non-degenerate 
distribution. 

Conversely, if E,^ = 0 and if for some positive finite constant K 

max[P(,^ > x), P(.^ < —x)] < exp(—x^Z-Y^), a; > 0, 
then S, G Sub(r2) and ||.^|| Sub < AK. 

The subgaussian norm in the subspace of the centered r.v. is equivalent to the 
following Grand Lebesgue Space (GLS) norm: 

||k|||:=sup[0f], |{|. lEkri'-'-. 

S >1 [v<s 

For the non - centered r.v. ^ the subgaussian norm may be defined as follows: 

||{||Sub:= [{||^-E{||Sub}2 + (EO0'l 

More detail investigation of these spaces see in the monograph [17], chapter 1. 

We denote as usually by I {A) = u E fl, Ae B the indicator function 

of event A. Further, let p be arbitrary number from the set [0,1] : 0 < p < 1 and 
let A{p) be any event such that P(A(p)) = p. Denote also Pp = I{A{p)) — p; the 
centering of the r.v. I{A{p))] then Epp = 0 and 

P(pp = l-p)=p; P(pp =-p) = 1-p. (1.11) 

The case p = 1—p = 1/2 correspondent to the considered before case of 
Rademacher’s random variable. 

Our goal in this short report is to investigate the value of the 
Rademacher’s norm for the random variable Pp. 

We derive in the third section a very simple non-asymptotical bilateral 
tail estimates for sums of these variables, not necessary to be identical 
distributed, under non-standard norming. 

Let us describe briefly some previous works. Define the following non-negative 
continuous on the closed segment p G [0,1] function 


so that (5(0 + 0) = Q{1 — 0) = 0 and Q‘^{l/2) = 1/8 (Hospital’s rule). Note also 

p^0+^Q{p) -7=^, p^l-0^Q{p) -(1.13) 

^|lnp| ^|ln(l-p)| 

The last circumstance play a very important role in the non-parametrical statis¬ 
tics, see [8], [12]. 

It is known [11], [3], [26], [5], [18], [19] that 

IIt^pII Sub = Q{p). 

Applications of these estimates in the non-parametrical statistics may be found 
in the articles [8], [12]. Other application is described in [6]. 

Another approach and applications see in the works [2], [3], [23], [24], [26], [27], 
[28] etc. 

2 Auxiliary result. 

Recall hrst of all that 

y = y{z) := cosh“^ 2 ; = \n{z ± \/z"^ — 1), z > 1. 

We agree to take only the following branch of these function 

y{z) = cosh“^ 2 ; = \\i{z + Vz"^ — 1), z > 1. 

Note that 

z^l + 0 y{z) ~ ^2{z-l), (2.0a) 

z—>■ cx) y(z)^ In z. (2.0b) 

The natural function for the family of the (centered) r.v. {pr}, 0 < r < 1 has 
a form 

/3,(A) + (1 - r)e-"^ A e (- 00 , 00 ), 0 < r < 1, (2.1) 

so that 

/9i/ 2(A) = 0.5 = cosh(A/2). 

Evidently, 


A —)■ cx) /9r(A) ~ r = const G (1/2,1), 



A —)■ 0 ^ /3r{\) ~ 1 + 0.5A^r(l — r), r = const G (0,1), 


Introduce an important function, which may be named as Rademacher’s norm 
of the binary random variable, 


gnir) = g{r) sup 

A^O 


cosh ^[/5r(A)] 

\m 


sup 


cosh + (1 — r)e 

\m 


r e (0,1). 


( 2 . 2 ) 


Proposition 2.1. It follows immediately from the direct dehnition of the B{(j)fi) 
norm that 


\\Vr\\B(l)R = g{r), 0<r<l. (2.3) 

Let us itemize now some important for us properties of introduced function 
g = gi'f') = 0 < r < 1. All this properties may be easily obtained from the 

known asymptotical behavior of both the functions y{z) and /Sr(A). 

1. This function is bounded and continuous on the closed interval [0,1]. More 
detail: the inequality 0 < 5f(r) < 2 is obvious. 

Moreover 


(/( 0 +) = < 7(1 - 0 ) = 2 . 

Note that the last equality stand in contradiction to the analogous fact (1.13) 
for the subgaussian norm for at the same binary random variable. 

As a consequence: the function g = g{r) can be dehned as a continuous positive 
function on the closed interval [0,1] such that (7(0) = 77(1) = 2. 

So, maXre[o,i] fl'(r) = 2 = ^((0) = ^((1). 

2. On the other hand, we obtain after some calculations 


gir) > lim 
A-^-O 


cosh ^[/9r(A)] 

\m 


= — r), r G (0,1) 


(2.4) 


3. Evidently, 77(1 — r) = g{r), (symmetry), so that it is enough to investigate 
this function only on the interval 1/2 < r < 1. 

4. It is easy to calculate 77(1/2) = 1. 

5. Note in addition 


77 (r) > lim 
I A| —^00 


cosh [/Sr (A)] 

\m 


but the last function is less than 2^r{l 


= 2 max(r, 1 — r), 
r). 


r G (0,1), 



The following rough estimate will be practically used in the next section. 

Proposition 2.2. 


sup \\rir\\G%ljR = l, (2.5) 

r€[0,l] 

or equally 

sup = cosh(A/2). (2.5a) 

re[0,i] 


Proof. 


1. It is sufficient to consider for reasons of symmetry only the cases r G [1/2,1] 
and analogously A > 0. 


2. Further, we have proved the following equivalent elementary inequality 

(3r{X) = + (1 “ r)e~^^ < cosh(A/2), r G (1/2,1), (2.6) 

wherein A > 0; the cases r = 1/2, r = 1 and r = 0 are trivial. 

3. Put for simplicity r = 1/2 + <5, <5 G (0,1/2), then we deduce after some 
calculations 


(3 = [cosh(A/2) + 25 sinh(A/2)]. 

4. Our inequalities (2.5) and (2.6) takes the form 

[cosh(A/2) + 2(5sinh(A/2)] < cosh(A/2) 


or equally 


2(5sinh(A/2) < cosh(A/2) — 1 


(2.7) 


The inequality (2.7) follows in turn taking into account the positivity of the 
value of product \5 from the one of the form 


sinh fx <2fj, cosh /i, /i = 2A > 0. 


( 2 . 8 ) 


5. The last inequality (2.8) may be elementary proved by means of juxtapositions 
of correspondent Taylor’s members. 

6. The equality in the assertion of proposition 2.2 is reached for example for the 
value r = 1/2 as well as as A —)■ cxd and as r ^ 1 — 0 or equally as r —)■ 0 + . 

This completes the proof of proposition 2.2. 



3 Main result: tail estimations for sums of inde¬ 
pendent indicators under non - standard norm- 
ing. 


Let p{i), i = 1,2, ...,n be positive numbers such that 0 < p{i) < 1, and 
let A{i) be independent events for which P(yl(i)) = p{i). Introduce a sequence 
of two - values (binary, generalized Rademacher’s independent random variables 
C •= {C(^)}) C(*) = ~'Pid)i and dehne its sum 

n 

S{n) (3-1) 

1=1 

where the norming function w = w{n) is any deterministic strictly increasing to 
inhnity numerical sequence such that tc(l) = 1. 

We intend in this section to derive the bilateral uniform expo¬ 
nential BOUNDS FOR THE TAIL OF DISTRIBUTION 

Tw{u) '^= sup sup max {P(S'(n) > u), P{S{n) < —u)}, u > 1, (3.2) 

^ {Cl 

where sup{^} is calculated over all the centered Rademacher’s independent random 
variables ( := {C(^)}- 

The normalization Wi/ 2 {n) = y/n can be considered a classic, see e.g. [13], [17], 
chapter 2, sections 2.1 and 2.2. For instance, if the r.v. are i., i.d, centered and 


max{P(C(i) > m), P(C(*) < < exp (— , u > 0, k = const > 0, 

then 


< exp [—C{k) ^ Q <c C(k) = const < cxd, 

and the last estimate is essentially non-improvable. 

It is known for instance, see [17], chapter 1, section 1.6 that 


||^C(^)l|Sub < . 

i=l ' 

Therefore, it is reasonable to suppose 

lim w(n)/\/n = oo: 

n^oo 

other case is trivial for us. 

On the on the other hand, if 

lim win)In = cx), 

n^oo ^ ' 

then evidently 


BllCWIISub)^. 

2=1 



^«'l/2(“)=0> U>1. 

Thus, we must exclude also both these cases. 

The exact formulating using for us assumptions will be specihed below. 

We shall touch briefly earlier work in the considered here problem. The particu¬ 
lar case of our statement of problem, even for the sequence of martingale differences, 
may be found in the articles [7], [14], [15], [16], [20], [21]. 

A very interest application to the investigation of the free energy of directed 
polymers in random environment is described in the article belonging to Liu Q. and 
Watbled F. [16]. 

Let us now itemize some conditions imposed on the norming function w = w{n). 

Al. There exists a strictly decreasing twice continuous differentiable function, 
dehed on the set A > 1, which we will denote also w = w{X), such that w{X)/x=n = 
w{n), n = 1, 2, 3,.... 

A2. 


A3. 


A —y oo 


A 


; 0 . 


A — y oo 


yx 


t CXD. 


A4. The inverse function A —)■ tc ^(A), A > 1 is convex. 

A5. The function A uj(X), A > 1 satishes the A2 — condition 


sup 

A >1 


w(2X) 

w(X) 


< 00 . 


(3.3) 


(3.4) 


(3.5) 


Dehne also a new function 

v(u) = Vw{u) := {u), u > 1. 

Recall that the transformation / ^ /* is named Young-Fenchel, or Legendre 
transform, see (1.4). 

Theorem 3.1. Let all the conditions Al - A5 be satisfied. We assert then as 
u ^ 00 


lnTu,(n) I X Vw{u). 


(3.6) 


Proof. 



1. Let us calculate (and evaluate) first of all the moment generating function for 
the sequence of r.v. S{n). We have using the independence of the r.v. ({i) 




A 


*) 


win) 


i=l i=l 

2 . One can use the proposition 2.2, more exactly, the estimate (2.5a): 


EeAS(n) 


A 


Win) 


= exp 


n In cosh 


A 


Win] 


(3.7) 


wherein the last inequality (3.7) is sharp: is achievable for instance when all the r.v. 
C(f) are Rademacher’s. 

On the other words, we can and will suppose all the independent variables C,{i) 
have the ordinary symmetrized Rademacher’ distribution. 


3. Therefore 


sup < sup 


exp 


n In cosh 


A 


Win] 


and it is easily to derive using the known properties of the function w{-) 

InsupEe^^^'^) x u;-^(A), |A| > 1; 

n 

the case |A| < 1 is simple. 

In particular, if we choose in the right hand (3.8) w{n) = A, then 
InsupEe^^(^) > C'i(m;) • u;-i(A), |A| > 1. 

n 

In detail, let A > 1. There exists an unique value no = no(tc. A) such that 

'U^~^(A) < no < w~^(A) + 1. 


(3.8) 


(3.9) 


(3.9a) 


Then 




and we have consequently no > w ^(A); 


A 


> 


A 


> 


A 


> 


w{no) w{w~^{\) + l) \ + w{l) l + ta(l)’ 

we exploited the convexity of the function t(;“^(-), condition A4. 
Thus, one can to choose in (3.10) 

CAw) = 


1 + w(l) 


We turn now to the withdrawal of the upper bound for the value Z : = 
sup„ Ee^‘^*'"'\ Dehne an absolute constant 



C = e + l/e-2^ 1.0862, 
For our purpose we estimate: 

In cosh A < A, A > 1; 


A2 \4 \6 

|A| < 1 ^ coshA = 1+ — + — + — + < 


IH-X 

2 




A2 \2 

1 H —— X [1 + 2 ■ (cosh 1 — 3/2)] = 1 + C* • —; 


|A|<1 


In cosh \ < C ■ 


A^ 


We hud combining the obtained estimates for the positive values A 


InZ = InsupEe^^^*^) < A ■ 


n 


w[n] 


I{n < w ^(A)) + 


C- 


\^n 

w‘^{X) 


■ I{n>w (A)), 


where I {A) denotes the indicator function for the predicate A. 
Obviously, 


InZ < A ■ ^ ■ /(I < fi < w ^(A)) + 

W{fi) 

w^{X) 

It follows immediately from the assumptions A1 - A5 that the function of the 
variable fi, fi > 1 in the right-hand side of the last inequality achieved its maximal 
value at the point fi = and herewith 

Z < exp , |A| > 1. 

Totally, we obtained the following uniform bilateral estimates for the moment 
generating function of the random sequence S{n) : 


exp w ^(A)) < sup< exp (jJw ^(A)) , |A| > 1. (3.10) 

4. The proposition of theorem 3.1 follows now from (3.10) and from the main 
result of the article [1], see also [17], chapter 1, section 1.4. 

Example 3.1. Let for instance w{\) = A^/^, A > 1; then 



In 


X U> 1. 


(3.11) 


sup 




u 


2=1 


Remark 3.1. Let us introduce the following function 

A ' 


6{X) := sup 


In cosh^ 


win) 


(3.12) 


so that 


sup (3.13) 

n 

It follows from the inequality (3.13) by means of Chernov’s inequality only 
unilateral inequality 

supmax(P(5'(n) > M),P(5'(n) < —u)) < u>0, (3.14) 

n 

still without all the conditions A1 - A5. 


4 Concluding remarks. 

A. It is known, see [25], that (after commensuration) if A be a mean zero r.v. 
X : EX = 0 and is bounded a.e.: |X| < 1/2, then 

Ee^^ < cosh(A/2), A G i?. 

On the other words. 


\\x\\B(1 >r<i, 

herewith the equality in the last estimate is achieved only in the case when X has 
the (symmetrical) Rademacher’s binary distribution. 

Therefore, all the results of theorem 3.1 remains true for the arbitrary sequence 
of independent centered such a variables, not necessary be identical distributed. 

This proposition can be considered as some complement to the classical theorem 
of W.Hoeffding [9], see also [2]. 

B. The case of sums of weakly dependent binary r.v., including sums of martin¬ 
gale differences, is investigated in the recent article [22]. 
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